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Abstract. Dunkl operators for complex reflection groups are defined in this 
paper. These commuting operators give rise to a parameter family of defor- 
mations of the polynomial De Rham complex. This leads to the study of 
the polynomial ring as a module over the "rational Cherednik algebra", and 
a natural contravariant form on this module. In the case of the imprimitive 
complex reflection groups G{m,,p, N), the set of singular parameters in the 
parameter family of these structures is described explicitly, using the theory 
of nonsymmetric Jack polynomials. 
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1. Introduction 



Let V he a, finite dimensional Hilbert space. A finite complex reflection group in 
the unitary group U (V) is a finite subgroup which is generated by pseudo-reflections 
(or "complex reflections"), transformations with all eigenvalues but one equal to 
unity. In this paper we introduce for each such group a commutative algebra 
of parameterized operators Ti{k) generalizing the partial derivatives di = Ti{0). 
Here k denotes an TV-tuple of complex parameters where N equals the number of 
conjugacy classes of complex reflections in the group. 

We prove the commutativity by showing that the perturbed De Rham complex, 
in which the role of the partial derivatives is played by the operators T'i(fc), is 
indeed a complex (i.e. the perturbed differential d{k) satisfies d{k)'^ — 0). At 
the heart of this argument lies the computation of a "Laplacian" E{k) for this 
complex. This operator gives rise to a parameter family of elements in the center 
of the group algebra, whose values on the irreducible representations of G are 
nonnegative integral linear combinations of the parameters k. These values seem 
to govern many of the properties of the operators Ti{k). In particular, analyzing 
these values easily leads to a proof of the commutativity of the Ti{k). 

In the course of this argument various natural structures arise: 

(i) The perturbed De Rham complex P ® /\' {V*) with differential (i(fc), where 
P is the ring of polynomials on V . 

(ii) Homogeneous, G-equivariant intertwining operators V(fc) on P, such that 

a,v(fc) = v(fc)r,(fc). 

(iii) An hermitian pairing (■, ■)]^ on P such that (x,;p, q)k = (j>, Ti{k)q)k. 

(iv) The ring P as a module over the "rational Cherednik algebra" A(fc), the 
algebra generated by C[G], Ti{k) and P (acting on itself by multiplication). 

A parameter value k is called singular if there exists a nonzero homogeneous poly- 
nomial p of positive degree such that for all i, Ti{k)p = 0. This turns out to be 
the only obstruction for the existence of a homogeneous equivariant intertwining 
isomorphism as in (ii). By this remark it is easy to see that k is singular if and 
only if there exists an i > such that the cohomology group W{k) of the De Rham 
complex with differential d{k) is nonzero. Another equivalent formulation is the 
statement that (•, •)fc is degenerate. From this one easily sees that k is singular if 
and only if P is not irreducible as an A(fc)-module. 

By these equivalent descriptions it is clear that the set of singular parameter 
values is of fundamental importance, and one of the goals of this paper is to find 
this set explicitly. We are not able to solve this problem in general, but we will derive 
that the singular set is always a locally finite union of affine rational hyperplanes 
in the parameter space. 

In the case of a Coxeter group one knows more about the above structures, and 
this was described in the paper |8|. The present paper grew out of an attempt to 
apply the methods discussed in g to the case of complex refiection groups. 

The complex reflection groups were classified by Shephard and Todd . There 
are 34 exceptional cases called Gi,i — 4, ..,37 (containing the exceptional real 
reflection groups) and an inflnite family of groups G{m,p, N) with m,p,N G N and 
p\m. The group G {m^p, N) is a subgroup of U (N) and consists of permutation 
matrices whose nonzero entries are m*^ roots of unity and the product of the nonzero 
entries is an (m/p)*^ root of unity. If = 1 we take p = 1 (cyclic groups of order 
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m acting on C). The groups G (1, l,N),G (2, 1,N),G (2, 2, N) are the Coxeter 
groups of types Ajv-i, Bpf, Dpf respectively. 

The infinite family G {rn,p, N) is studied in detail in the second half of this paper, 
by means of the theory of nonsymmetric Jack polynomials. A complete orthogonal 
decomposition for the pairing associated with G {m,p, N) is obtained with explicit 
norm formulae. This leads to a precise description of the set of singular values 
and the construction of shift operators which transform between the structures for 
contiguous parameter values. 

Various alternative interpretations are known for the singular parameter set in 
the case of Coxeter groups (see also |^ ) . It is closely related to the non-semisimple 
specializations of Hecke algebras (see [|l5|). Likewise it is closely related to the 
zeroes of the Bernstein- Sato polynomial of the discriminant (see [pi). In this 
regard it is also interesting to compare with the results of the paper M. It is an 
interesting question whether some of these interpretations survive in the general 
case of complex reflection groups. The Hecke algebras to be considered are the 
topological cyclotomic Hecke algebras studied in (also |l7| ). 

We note that the algebra A(fc) naturally fits in the framework of the symplectic 
reflection algebras that were recently introduced by Etingof and Ginsburg . As 
is mentioned in that paper, this provides an alternative proof of the commutativity 
of the operators Ti{k). Yet another approach to the proof of the commutativity is to 
show the integrability of the related Knizhnik-Zamolodchikov connection directly, 
using geometric arguments along the lines of (see for the details of this 
argument). 

Acknovirledgments. The authors wish to thank Pavel Etingof for a helpful 
discussion. 

The authors were participants in the programme on Symmetric Functions and 
Macdonald Polynomials during the preparation of this paper, and gratefully ac- 
knowledge the hospitality of the Isaac Newton Institute for Mathematical Sciences 
at Cambridge. 

2. DUNKL OPERATORS FOR COMPLEX REFLECTION GROUPS 

2.1. Complex reflection groups. Let ^ be a finite dimensional Hilbert space, 
and let U{V) be the group of unitary linear transformations of V. An element 
g £ U{V) is called a complex reflection if g has finite order and Hg := Ker(g — Id) is 
a hyperplane in V. A finite subgroup G C U (V) is called a finite complex reflection 
group if G is generated by complex reflections. 

Let G C U{V) be a finite complex reflection group. If C is a linear 
subspace, we denote by Gw C G the subgroup of those elements of G which flx 
the elements of W. By a well known result of Steinberg Gw is itself a flnite 
complex reflection group. Clearly, Gw acts faithfully on W^. In particular, if 
i? C y is a hyperplane, then Gh is a cyclic group. If Gh ^ {Id} we call H 
a reflection hyperplane. When is a reflection hyperplane, we denote by the 
order of the cyclic group Gh- The collection of all reflection hyperplanes is a central 
hyperplane arrangement .A in V ^ on which the group G acts. Let us denote by C 
the set of G-orbits in A. Obviously, eu only depends on the orbit C = G ■ H e C. 
We will write ec instead of ch whenever this is convenient. 

Let det be the determinant character on UiV). When H <zV is a. reflection hy- 
perplane, the characters of Gr also form a cyclic group, generated by the restriction 
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Xh of det to Gh- We will thus label the character group of Gh by 

(1) GH = {x7\i = 0,---,eH-l}. 

For each of the reflection hyperplanes we choose a functional an € V* such that 

Ker(a_f/) = H. 

The group G acts on the ring P of polynomials on V in the usual way, i.e. 
p^{x) := p{g~^x). The functional aH transforms under the action of Gh according 
to the character x'h' ■ A polynomial p which transforms under the action of Gh 
according to a nontrivial character must vanish on H. Consequently, a polynomial 
which transforms under the action of Gh according to Xh^ with i G {l,...,ejif — 1} 
is divisible by a\j. 

2.2. Dunkl operators. Given H € A and i e {0, 1, . . . , ejj — 1}, let 

(2) eH,i:=— xhi9)9&C[GH], 

be the idempotent of C[G//] of the character xli ■ addition, choose a list of 
complex numbers k = {kc,i), where C runs over the set of orbits C, and for each 
C e C, i G {l,...,ec — 1}. With these data we form, for each reflection hyperplane 
H, the element 

eff-l 

(3) an = anik) = ^ eHkH,ieH,i e C[Gh]- 

Notice that the iH,i with i e {l,...,e// — 1} constitute a basis of the subalgebra 
in C[G/f] consisting of the elements ^g^Q^ CgQ G €-[Gh] such that Cg = 0. Also 
notice that the elements an are equivariant with respect to conjugation in the group 
algebra: for all g € G, 

(4) gaH9~^ = agH- 

Let ^ e y, and denote by the derivation of P associated to the constant 
vector field on V defined by ^. By what was said above, we can define the following 
"Dunkl operator" on P: 

(5) mk) =d^+Y^ aHiO^H^aHik), 

where aH{k) is considered as operator acting on P. The operator indeed maps 
polynomials to polynomials, since en.oaH = 0, so that we can divide by aH after 
applying anik). The next proposition is now clear: 

Proposition 2.1. (i) The operator T^{k) does not depend on the choice of the 
functionals an- 

(ii) Tj(fc) ^5 equivariant with respect to the action of G on P and V: 

(6) gT^g-^ = Tg^{k). 

(iii) T^{k) is homogeneous of degree —1. 

Let K* = P (g: /\' V* denote the algebra of polynomial difi^erential forms on V. 
Let n{k) G End(P) (g) be given by 

(7) nik) = aH{k)^H, 
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where ujh ■= a~^(kxH is the logarithmic differential of an (which is independent 
of the choice of aH, and Gij-invariant). 

Lemma 2.2. The operator il(fc) : P — > is G-equivariant with respect to the 
usual action of G on P, and the diagonal action of G on . 

Proof. This is clear since both oh [k) and u>h are equivariant for the natural actions 
of G on P and on the space of (rational) 1-forms on V . □ 

Wc write d{k) : P — >■ to denote the map d{k){p) = dp + Q{k){p). Thus we have: 

(8) mk){p) = cMk)ip)), 

where denotes the contraction with the constant vector field ^. We extend the 
operator d{k) to K* in the usual way: for all p G P and w G /\' V* we define 

d{k){p ® bj) = d{k){p) A w, and extend this linearly to K* . Note however that, 
unlike the case fc = 0, this is not a derivation of the algebra K* . 

Lemma 2.3. We have the following equivalent definition of d{k) on K'. Extend 
n{k) to the G-equivariant endomorphism D,{k) on K* which is defined by D,{k){(jj) 
— '^}jfz^o,H{k){(-OH A Lo) for LO G K* , where a.H{k) acts diagonally on K* . Then 
d{k) = d + ^(k). The operator d{k) is equivariant for the diagonal action of G on 
K\ 

Proof. If 5 S Gh, then € x + Can, for all x & V* . In addition, coh is Gh- 
invariant. Hence if a; = p (8> dxi A • • • A dxi, then 

(9) {aH{k){p)) loh a dxi A ■ ■ ■ A dxi = aH{k){p (8> ujh A dxi A • • • A dxi), 

where we used the diagonal action of G on the right hand side. The equivariance 
of d{k) follows from the previous Lemma. □ 

Consider the Koszul differential d on K*. This differential is defined by: 

I 

p (g) dxi A • • • A dxi — »■ '^^{—ly^^XrP ® dxi A ■ ■ ■ A dxr A ■ ■ ■ A dxi. 

r=l 

Observe that d isU (y)-equivariant with respect to the diagonal action of U {V) on 
K'. 

Let -E'(O) denote the Euler vector field on V. This vector field is the infinitesimal 
generator of the action of on y (by scalar multiplication). Differentiating the 
diagonal action of on K* wc obtain an action of £"(0) on K*, the "diagonal 
action". In other words, if we put K^^ = P^ <^ /X'' V* , then E{0) has eigenvalue 
Z + m on Kl^. Notice that d{k){Kl^) C K''+\ and that d{Kl^) C -fsT^+i- 

Proposition 2.4. Let E{k) = E{0) + Y^HeA'^^ik), acting diagonally on K* . 
Then dd{k) + d{k)d = E{k). 

Proof. It is well known that 9rf(0) + d(0)9 = -B(O), since d(0) is the ordinary De 
Rham differential on K' . 

Extend the operators d{k) and d to the complex K of rational differential forms 
on V in the natural way. For each H G A, define the operator wh ■ K K by 
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WHiv) •= '^-ff A ry. By the previous Lemma and the equivariance of d we have 

danWH + o-HWud = 

aH{dwH + wnd) = an- 
This finishes the proof. □ 

The next Lemma is of crucial importance in all that follows. 

Lemma 2.5. We put z{k) = J^hga^^^^^ ^ C[G]. This element of the group 
algebra has the following properties: 

(i) The element z{k) is in the center of<C[G]. 

(ii) For {Vr,T) e G, let Cr{k) denote the scalar such that z{k) acts on Vr by mul- 
tiplication with Cr{k). Then Cr{k) is a linear function of k, with nonnegative 

integer coefficients. 

(iii) Let triv denote the trivial representation of G. Then Cr{k) = if and only if 
T = triv. 

Proof, (i) This follows immediately from the equivariance of the elements an- 

(ii) Let the restriction of r to Gh be 

(10) t\g„ = J2 ^^h.^Xh' 

i=0 

for certain nonnegative integers nj^ j. Observe that these branching numbers only 
depend on the orbit G = G ■ H oi H. Hence the trace of z{k) on Vt equals 

(11) traceT(^;(fc)) = X] X] \^\^cnc^ikc,i, 

cec 1=1 

showing that Cr{k) is linear with nonnegative rational numbers as coefficients. On 
the other hand, z{k) is a linear expression in the kc,i, with coefficients that are 
central elements of the algebra A[G], where A denotes the ring of algebraic integers. 
By a well known result in the theory of representations of finite groups, the central 
elements of A[G] assume algebraic integer values on the irreducible representations 
of G over C. This proves the result. 

(iii) If Cr{k) = then it follows from the proof of (ii) that for each H G A, t\gh 
contains only the trivial character of Gh- Since G is generated by the subgroups 
Gh, this implies that r = triv. □ 

Corollary 2.6. Let X, Y, Z denote the generators of an associative algebra C, sat- 
isfying the relations XY + YX = Z, X'^ = [Z,X] = [Z,Y] = 0. The map X ^ d, 
Y d{k) and Z E(k) extends to a representation of C on K* . 

Proof. If T e G, we put Kl^ ,^ for the r-isotypic component of Kl^. We have 
d{Kl^,) C K'-l^^^, d{k){Kl^,) C K'+\^^, and finally E{k){Kl^,) C K^^,. It 
also follows immediately that E{k) commutes with d and d{k). □ 

We put K{r,T) := ©,+„=^is:^^, and K{0) = = C. 

Corollary 2.7. K{r,T) is a finite dimensional G-submodule, and K' decomposes 
as direct sum K' = (Br>o,TK{r,T). 
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Furthermore we write K*{+) := ®r>o,TK{r, t), which is the (7-subniodule of K* 
complementary to K{0). We thus have the decomposition K' = K*{+) K{0). 

Corollary 2.8. Assume that for all t e G, -Cr{k) ^ N. Then 

(12) Ker(d(fc)) n K'{+) = Ker(d(fc)) n lm{d{k)). 

In particular, Ker(d(fc)) n K"{+) = {0}. 

Proof. E{k) acts by scalar multiplication with r + CT-(fc) on the submodule K(r, r). 
Therefore, by the above assumption, E{k) is invertible on each C-submodule K{r, r), 
with the exception of K{0). Write E{k)~^ for the inverse of E{k) on K*{+). Let 
to e Ker((i(A;)) fl K*{+), then 

Lu = E{k)-^E{k){uj) 

= E{k)-\dd{k) + d{k)d){cu) 

= d{k){d{E{k)-^uj)). 



This shows that 77 = d{E{k)-^uj) G K*{+) is a solution of d{k){ri) = LU, proving the 
desired result. □ 

Theorem 2.9. Assume that for all t £ G, —c-rik) ^ N. We call a linear operator 
V : K* — > K' completely homogeneous ifV{Kl^) C K]^-^, for all l,m. There exists 
a unique completely homogeneous linear map V{k) : K* — > K* such that 

(i) V{k) is the identity operator on K{0) = C, 

(ii) V{k){p (g) w) = (V(fc)p) ® UJ, for all lu e /\' V* = K^, and 

(iii) d(fc)V(fc) = V(fc)d(0). 

Moreover, V{k) is a G-equivariant linear isomorphism. 

Proof. First we show that if V{k) exists, it is necessarily a linear isomorphism. If 
not, let m be minimal such that V(fc) has a nontrivial kernel in K!^. By (ii) this 
implies that Pm n Ker(V(fc)) 7^ 0, and by (i) we see that m > 0. Let 7^ p £ P^ 
be such that V{k)p = 0. By (iii) we see V{k)d{0)p = 0. By the assumption on m 
this implies that d{0)p — 0, and since m > this is a contradiction. Note that this 
argument is independent of the assumption on k, since it only uses that d{0)p — 
implies that p = if p G Pm with m > 0. 

A similar argument shows that V{k) must be unique. If not, there exists a 
nonzero completely homogeneous operator W satisfying (ii) and (iii) but with 
W{K^) = 0. Let TO > be minimal such that W(if;^) ^ 0. By (ii) this implies 
that W(P„0 ^ 0. Let p £ such that Wp ^ 0. But then d{k)Wp = Wd{0)p = 0, 
which implies that Wp £ Kei{d{k)) n K'^{+). Given the assumption on k, this 



contradicts Corollary 2.8 



We now construct V(fc) by induction on the degree m. Suppose that m > and 
that we have already constructed V(fc) on K* for i < m, satisfying (i), (ii) and (iii). 
Let p e = Pm- Then d{k){V{k)d{0)p) = 0, and thus, by the previous corollary, 
there exists a unique q G Pm such that d{k)q — V{k)d{0)p. Hence we define 
V{k)p = q. For any uj £ Kq and p G Pm we now put V{k){p (g) w) = (V(fc)p) (g) w, 
and use this to define V(fc) on iiT^. It is immediate that V(fc) satisfies (i), (ii) and 
(iii). 
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The G-equivariance of V(fc) now follows from the equivariance of d{0) and d{k). 

The equivariance implies that for any g G G, g o V{k) o also meets the re- 
quirements (i), (ii) and (iii). By the uniqueness property we conclude that V(/c) = 
goVik)og-\ □ 

Corollary 2.10. The map d{k) is a differential on K* , i.e. d{k)^ = 0. In addi- 
tion, the complex {K*{+),d{k}) (with K'{+) := (Br>o,TK{r,T)) is acyclic (i.e. its 
cohomology is 0) if we assume that for all t G G, —Cr{k) ^ N. 

Corollary 2.11. The representation ofC on the submodule K(r,T) (in which Z = 
E{k) acts by scalar multiplication with s := r + Cr{k)) factors through the Clifford 
algebra C{s), the associative algebra with generators X and Y, and relations XY + 

YX ^ s, X^ =Y^ = 0. 

The next reformulation is the main result of this section: 
Theorem 2.12. For all ^,r]€V, T^{k)T^{k) = T^{k)T^{k). 

Proof. Choose a basis Ci of V, with dual basis xj of V* . Put Tj = T^.{k). A simple 
direct computation shows that for all p € P, 

(13) d{k fp = ^{T,Tj - TjTi)p ® dxi A dxj. 

Hence the statement rf(fc)^ = is equivalent to the commutativity of the Tj. □ 

Corollary 2.13. The restriction ofV{k) to P satisfies T^{k)V{k) = V{k)d^. 

Proof. The point is that, because of defining property (ii) of V(fc), V(fc) commutes 
with the contraction cj for each £, & V. Thus we obtain: 

T^{k)V{k)p = c^{d{k)V{k)p) 

= c^{V{k)d{0)p) = V{k)d^p. 



□ 

When ,s := r + c^(fc) ^ 0, the Clifford algebra C{s) is semisimple and has only 
one irreducible module ~ C^, with basis a, b such that 

Thus K{r, t) is isomorphic to a direct sum of copies of the irreducible representa- 
tion T Af" of C[G] g) G(s). The "cohomology" H{t (g) M*) := Ker(y)/Im(y) is 
equal to in the module r (g) M*. However, the algebra G(0) is the Grassmann 
algebra. This algebra is no longer semisimple. The space of equivalence classes of 
indecomposable modules of the Grassmann algebra is complicated, and the "coho- 
mology" Ker(y)/Im(y) is not necessarily in the indecomposable modules. This 
happens for the only irreducible representation of G(0), the trivial representation, 
but it may happen for nontrivial indecomposable modules as well. Note that for all 
parameters values k, the trivial representation of G(0) is contained in K' at least 
once, in the form of the submodule K{0). 
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2.3. Singular parameter values. Let W{k) denote the i-th cohomology group 
of the complex {K*,d{k)). The foUowing are equivalent: 

Corollary 2.14. (i) iJ'(fc) = 0, for all i > 0. 

(ii) H"{k)^C. 

(iii) There exists a completely homogeneous intertwining map V(fe) satisfying the 



conditions (i), (ii) and (iii) of Theorem 2.i 



Proof. (i)==>(ii): The complex {K*,d{k)) is a direct sum of the finite dimensional 
subcomplexes K*{n) = (Bi+m^nKl^. Let us denote by H^{n,k) the cohomology 
groups of {K' (n) , d{k)) . The Euler characteristic 

(15) x{n) := Y.(-^y ^^MH\n, k)) = ^(-1)' dim(/C_.) 

is independent of k. Hence for all k, xi^) = if n > 0. Thus for all n > and k 
we have: if fc) = for all i > 0, then H°{n, k) = 0. 

(ii) =>(iii): We carry out the proof of the existence of an intertwining map >V(fc) 
as in Theorem |2.9| , but with the role of d[Q) and d{k) interchanged. We can do 
this, because we now know that d{kY = 0. Since we assume that H^{k) = C, we 
see that the proof of Theorem ^.9| showing that the intertwiner has to be a linear 
isomorphism also applies in this situation. Hence V(fc) — W(fc)~^ is an intertwining 
operator as required. 

(iii) =^(i): The argument in the proof of Theorem |2 . 9| showing that V{k) has to be 
a linear isomorphism applies for all k. Hence V(fc) defines an isomorphism between 
the cohomology spaces -ff*(0) and H'^{k). □ 

Definition 2.15. The parameter k is called regular if the equivalent statements of 



2.14 hold. Otherwise we say that k is singular. 



We saw in Corollary |2.10| that if k is singular, then there exists a r G G such that 



-Cr{k) — m £N. More precisely we have: 

Corollary 2.16. For t £ G, let Pt denote the r-isotypical component of P, and 
Pm,T the T-isotypical component of Pm. If k is singular, there exists ar € G and 
m £N .such that CT-(fc) + m — and Pm,T 7^ 0. 

Proof. If k is singular then there exists a submodule K{m, r) of K' such that 
H°{K{m, r), rf(fc)) 7^ and m G N. This implies that (P^ : r) > and c^(fc) +m = 
0. □ 

The converse statement is false. A counterexample occurs already in the case of the 
symmetric group 6*4. Let t be the irreducible 3 dimensional representation (2, 1, 1). 
Then P^^r 7^ and Cr{k) = 8fc, but k = —5/8 is not a singular parameter. 

In the case of a finite Coxeter group, the set of singular k can be determined 
exactly, cf. [^. In the present generality we do not know how to prove a similar 
explicit description. 

2.4. An hermitian form. For ^ £ V, denote by ^* G V* the element such that for 
all r/ G V, ^*{ri) = {CtV)- The map ^ — * ^* is an anti- linear isometric isomorphism. 
We extend this to an anti-linear isomorphism * : S' ^ P, where 5* denotes the 
symmetric algebra on V. The inverse map is denoted by * as well. By the commu- 
tativity of the operators T^{k), we can uniquely extend the linear map ^ T^{k) 
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to obtain a linear map from S to End(T/). This map will be denoted by s — * s(T) 
(or by s — > s{T{k)) if necessary). We define a sesquilinear pairing (•, ■)k on P by 

(16) {p,q),:={p*{T{k))qm. 

Proposition 2.17. (i) For all g £G, {p\ q<^)k = (p, q)k- 

(ii) (rp,9)fc = (p,Te(fc)<z)fc. 

(iii) iPrn,T,PLa)k ^ if in ^ I orifr^a. 

Proof, (i) This follows from the remark that for all p e P, g e G, (p^)* = gip*), 
since for we have, for all x ^ V* and v € V: 

(17) {gx*,v) = {x\g-\) = x{g-^v) = x^iv) = {{x^y^v). 
Hence by the equi variance of T^{k) we have: 

ip',qnk = {{g{p*mk)))qsm 

- {{gop*{T{k))og-^)q9)iO) = (p*(T(fc))q)9(0) = ip,q)k. 

(ii) This follows immediately from the definition, using the commutativity of the 

mk). 

(iii) From the definition we see that {Pm,Pi)k = if ^ 7^ m. By (i) it follows 
that (ep, q)k = (ep, eq)k = (p, eq)k for every self-adjoint idempotent e of C[G]. This 
implies (iii). □ 

The main theorem of this section is: 



Theorem 2.18. The pairing satisfies {p,q)k — {q,p)-j:. 



Proof. We prove this by induction on the degree m. By Proposition 2.17 it is 



enough to show that for every r e G and m e Z^, (p, q)k ~ (QtP)]^ if Pi 9 ^ Pm.r. 
Assume by induction that this statement holds true for all p,q d Pi^a with I < m 
(the case m = being trivial). Let denote an orthonormal basis of V, and let 
Xi — e* den ote the dual basis of coordinates on V. Then, since c^(fc) = CT-(fc) by 



Lemma 2^, we have for all p,q Pm,T'- 

(to + Cr{k)){p, q)k = {E(k)p, q)k 

= C^x^Ti{k)p,q)k 

i 

^Y.{T,(k)p,T,ik)q)k 

i 

= J2mk)q,T,(k)p)j: 

i 



= (m + c^(fc))(g,p)p 

Since (p, q)k depends polynomially on k and since {I + Cr{k)) ^ for generic values 
of fc, this proves the necessary induction step. □ 

Corollary 2.19. For all x G V* andp,q G P we have {Tx*{k)p,q)k — {p,xq)k- 
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Proof. We have 



(T.^*{k)p,q)k = {q,T^-{k)p)i 



{P,xq)k- 



□ 



As was noticed in Proposition ^.17 , the finite dimensional subspaces Pm.r C P 



satisiy {Pm,T, Pi.cr)k = unless m = I and t = a. It follows that there exists a 
polynomial p ^ such that (p, P)fe = if and only if there exists a polynomial 
q ^ such that {P,q)k = 0. In this case we call the sesquilinear pairing {■,-)k 
degenerate. 

Proposition 2.20. The following are equivalent: 

(i) k is singular. 

(ii) {■,-)k is degenerate. 

(iii) There exists a proper graded ideal I d P which is stable for the action of the 
operators Tj(fc). 

(iv) k is singular. 

Proof. (i)=>(ii) Choose m > such that there exists a 7^ p G Pm with d{k)p = 0. 
Then (P,p)fc =0. 

(ii) ^(iii) Take / := {p \ {P,p)k = 0}. 

(iii) ^(i) Let m > be minimal such that 9^ 0. Then d{k)Im — 0. 
(i)<^(iv) By the above text, there exists a q ^ such that (P, q)k = if and only 



if there exists a p G P, p ^ such that {p, P)k — 0. But by Theorem this is 
also equivalent to {P,p)-f: — 0. Hence, using the equivalence of (i) and (ii), we see 
that (i) is indeed equivalent to (iv). □ 

Corollary 2.21. The set K"'^'^^ of singular parameter values consists of an infinite 
union of hyperplanes Km,T. Here Km,T denotes the hyperplane given by the equation 
m + Cr{k) — 0, and the union runs only over pairs (m,T) with t nontrivial and 

Pm,r + 0. 



Proof. By Proposition 2.16 we know that K^'^^^ is contained in the above union of 
hyperplanes Km,T- Notice that this is a locally finite set of hyperplanes. On the 
other hand, by the above Proposition, K'^™^ — UmefiK^^^'^ where K^^'^" denotes 
the set of parameter values k such that {■,-)k is degenerate on P„i. Now K^^'^"- is 
given by the condition that the determinant of {•,-)k with respect to a basis of Pm 
vanishes. Hence K^^'^^ is an algebraic hypersurface in the parameter space. Since 
it has to be contained in LiK^.r, it follows that, as a subset of the parameter space, 
Kfjf^^"^ is a union of hyperplanes Km,T- This proves the claim. □ 

Corollary 2.22. Let Kr denote the Q-vector space of rational parameters k (i.e. 
kc,i £ Q for all C , i). The set K^^"^ ClKr is a (locally finite) union of hyperplanes, 
and if is the union of the complexifications of these rational hyperplanes. 



Proof. The hyperplanes K„i.t are all rational, by Lemma 2.5. □ 
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Corollary 2.23. For every pair (m,T), there exists a basis (bi) of Pm.r such that 
the determinant of (hi, bj)k is a product of linear factors of the form I + Ca{k) with 
(J £ G nontrivial, and Pi u ^ 0. 

Proof. The determinant is a polynomial in C[K] such that its zero set is contained 
in if^^f*^". Hence it contains only irreducible factors of the form I + Ca{k). The 
determinant is determined up to multiplication by an arbitrary nonzero positive 
real number by change of basis. When we specialize at fc = 0, the pairing is clearly 
positive definite hermitian, and thus we can fix the normalization by choosing an 
appropriate basis. □ 

The above results show that, in order to describe the set K^^"^ , it suffices to describe 
if'^f nKr. By Proposition this is equal to the set K'^^sen p, particular 
we may restrict to real parameters, which has the advantage that, by Theorem ^.18 , 
the form {■,-)k is hermitian: 

Proposition 2.24. Suppose that k is real. Then 

(i) {■,-)k is hermitian. 

(ii) Suppose moreover that, for all nontrivial irreducible representations t G G, 
Cr{k) + m{T) > 0, where TO(r) denotes the lowest homogeneous degree such 
that (r : Pm{T)) (this holds in particular when all the parameters satisfy 
kc,j > Oj. Then (•, ■)k is positive definite. 



Proof, (i) This is immediate from Theorem 2.18 



(ii) This follows by induction on the homogeneous degree m, by taking p — q in 
the computation in the proof of Theorem 2.18. □ 

2.5. Lowest weight modules over the rational Cherednik algebra. We as- 
sume that k is real throughout this subsection. Let us consider the structure of P 
as a module over the rational Cherednik algebra A(fc), the algebra generated by 
C[G'], T^(fc) and P (acting on itself by multiplication) (see [p^). 

Lemma 2.25. For p G P, denote by m(j)) the operator m{p) : P ^ P, m[p){q) = 
pq (multiplication by p). For convenience, we put kcfl = 0, and for j G Z we define 
kcj — kcj' if j — j' is divisible by cq. In A{k) we have 

(18) 

m{k),m{p)] = m{d^p) + X! X! ^H{kH,%+] - fcHj)ai/(^)a^^TO(eH,i(p))eff,j. 
In particular, we have 

(19) [mk),m{x)]^x{0+Y. E Cg{k)aH{0^{vH)aH{vH)-'9, 

HeAgeGH.9^1 

where vh V is the vector such that {vh,v) — aniv) for all v Cz V, and where 
Cg{k) is the constant 

e„-l 

(20) cg{k) = J2 x'H{9){kH.j+i - kH,j). 
The function g — ^ Cg(k) is invariant for conjugation of g by G. 
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Proof. This follows in a straightforward way from the equations 

e ff- l 

(21) p=J2'hAp) 

1=0 

and 

(22) [eH,j,m{eH,i{p))] = m{eH,iip)){eHj-i - ^h,j)- 

□ 

Let us describe how A(fc) fits into the framework of the paper Consider the 

abstract associative algebra T{V + V*) ® C[G'], the smash product where G acts 
diagonally on the tensor algebra T{V + V*). We introduce in this algebra the 
relations t]] — (for all ^, ?/ £ V), [x, y] = (for all x,y & V*) and finally, 

where Cg{k) is as in equation M. The resulting algebra A'{k) is a symplectic re- 
flection algebra in the sense of |lCl|. In particular, by Theorem 1.3 of jl0|, A'{k) 
has the PBW-property (this means that A'(fc) is isomorphic as a vector space to 
P ^ S ^ CIG]). By construction, A(fc) is a quotient of A'(fc) via P 3 p ^ 'm{p): 
S 3 p* ^ p*{T{k)) and g ^ g (action in P). Using the PBW-property one easily 
identifies the A'(fc)-module P as 

(24) P = IndfWe,(t™), 

where triv is the one dimensional representation such that G acts trivially, and 
triv{V) = 0. In fact, it is not hard to see that P is a faithful module over A'(fc) 
(see ||l^. Proposition 4.5). We will therefore identify A'(A;) and A(fc) from now on. 

In the above construction we identified P with an induced module. We generalize 
this construction in the following way. Let (V, r) be an irreducible module of G. 
We extend t to the algebra 5* ® C[G'] by demanding that t{V) = 0. We define 

(25) M(r,fc):=Ind^'^^;^,(r). 

In the sequel we will usually suppress the parameter fc e if in the notation if no 
confusion is possible. As a vector space, M(t) ~ P (g) F. The action of G is the 
diagonal action, P acts by multiplication in the left factor of the tensor product, 
and the action of T^{k) is given by 

(26) 

e ff- l 

Tj(p (g) -y) = ti + ^ ^ eH{kH,i+j - kH,j)aHiOaJj^eH,iip) ® f-H,j{v), 

according to equation So we have in particular that P = M{triv). 

Lemma 2.26. Let a E G and m G Z+. Let M{t)„ of denote the a-isotypic com- 
ponent of M{t), and let M{T)m,a = M{T)a n (Pm V). The deformed Euler 
vector field Eik) — ^^XiTiik) acts on M{T)„i.a- by multiplication with the scalar 

m - Cr{k) + Ca{k). 
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Proof. From equation ^ we see that, for p e _P,„, 

E{k){p ®v) = mp(g)v - ^ enkn.jP ® ^Hjiv) 

HeA j=0 
ejj-l 

HeA 1=0 i+j=/ mod Cff 

e jf- 1 

= {m - Cr{k))p ®v + ^ eHkH,ie-%^i{p®v), 

1=0 

where ; denotes the idempotent en.i acting diagonally on P ® T^. Thus on the 
<T-isotypical part M{T)m,a of Pm ® V, the action of E{k) is scalar with eigenvalue 
m — Crik) + Ca{k), as claimed. □ 

Proposition 2.27. All A{k)- sub-modules of M{t) are graded. In other words, if 
M C M(t) is an A{k)-submodule, then 

(27) M ^ ©™ez+Mm 

with Mm '.— M n {Pm ® y)- With respect to this grading, T^{k) has degree —I, x 
has degree +1, and g G G has degree 0. 

Proof Let M C M{t) be an A(fc)-submodule. Since C[G] C A{k), we have M = 
(B^^qM^. By the preceding Lemma, the eigenvalues of the operator E{k) separate 
elements of different homogeneous degree in each isotypic part Ma-. Therefore 
Ma = (BnMcr fl {Pm (8) V^), and thus M itself is also the direct sum of its graded 
pieces. □ 

Corollary 2.28. The module M{t) has a unique proper maximal submodule. In 
particular, M{t) is indecomposable. 

Proof. Since r is irreducible for the action of G, a submodule M C M{t) is proper 
if and only if M nV = {0} (where V = M{t)o as before). AU submodules M C P 
are graded, and therefore the sum M' of all proper submodules of M(t) also has the 
property that M' DV = {0}. Hence M' is the unique maximal proper submodule 
of M(t). □ 

Definition 2.29. We call a module M over A{k) a lowest weight module with 
lowest G-type t if M is a nontrivial quotient of M{t, k). We denote by L{t, k) (or 
simply L{t)) the unique irreducible quotient of M{T,k). 



The above Proposition ^.27 shows that all lowest weight modules M with lowest 



G-type r have a unique "natural" grading 
(28) M = ®„ez+M„ 

such that Mq is the irreducible C[G]-module of type r. Note that the submodules 
of lowest weight modules are also graded (as they are subquotients of M{t)). Note 
however that the grading induced by M on a lowest weight submodule M' of M is 
shifted with respect to the natural grading of M' (unless M = M'). 
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Notice the analogy with the theory of highest weight modules for a semisimple 
Lie algebra over C. The role of Verma-modules is played by the modules M(t). 
Let us call an element m e M of a lowest weight module M of A(fc) primitive if 
T^{k)m = for all ^ £ 1^. Clearly the subspace of primitive elements in AI is 
a graded G-subspace of M. 

Proposition 2.30. Let M be an K{k)-module generated by a subspace Mq of prim- 
itive vectors such that Mq is an irreducible C[G]-module of type t. Then there exists 
a surjective homomorphism (j) : M{t) M such that (^(A/(r)o) = Mq- The homo- 
morphism (f> is unique up to a scalar. 

Proof. This is clear by the universal property of induced modules. □ 



Proposition 2.31. (i) Let M be a lowest weight module with lowest G-type r, 
graded with its natural grading. Then the a-isotypic component of 
is contained in M„(7.o.) with m{T,a) := Cr{k) — Ca{k). Ln particular, is 
finite dimensional. 

(ii) Let m G Z+ be such that M^^ ^ 0, and let H C be an irreducible G- 
subspace of of type a. The subspace J{H) := PH C M is a lowest weight 
submodule of M , of lowest G-type a. 

(iii) Let m G be maximal such that ^ 0, and let H C be an irreducible 
G-subspace of of type <j. Then J{H) ~ L{a). 

(iv) //, for all a ^ G, Cr{k) — Ca{k) ^ then M{t) is irreducible. 

Proof (i) Suppose MP _^ ^ 0. By definition of primitivity, E{k){MP^^^) = 0. On 
the other hand, E{k) acts by multiplication with the scalar m — Ct-(A:) + Ca{k) on 
M{T)m,a- Since Mm,a IS a quotient of this space, E{k) also acts on M^.a via 
multiplication with this scalar. The equation m = m(T, cr) for the degree m follows. 
In particular, the dimension of is bounded by 

(29) d{M) dini(M„(,,,)). 

crSG 

(ii) J{H) is an A(fc)-submodule of M, because T^{k){ph) = [T^{k),m{p)]{h) and, 
by equation [T^, we have [T^{k), m{p)] G P(E)C[G]. By the above Proposition, J{H) 
is a quotient of M(cr). 

(iii) By the condition on m we see that J{H)p = H, since clearly J{H)p C MP. 
Thus every nonzero submodule of J{H) contains H , and is therefore equal to J{H). 
Thus J{H) is the unique irreducible quotient of M(a). 

(iv) This is a special case of (iii), since the condition implies that the maximal 
value of m such that M(t)^ ^ is equal to 0. Thus we can take H = V — M{t)o 
in (ii) to see that M{t) = L{t) in this case. □ 



Corollary 2.32. Each lowest weight module M has a finite Jordan-Holder series 
whose irreducible quotients are isomorphic to modules of the form L{a). 

Proof. By proposition ^.31 it is clear that M contains an irreducible submodule 
Ji isomorphic to L{ai) for some cti. If A^i := M/Ji = we are done. If not, 
we continue by choosing an irreducible submodule J2 ~ L((T2) in TVi, and form 
the quotient N2 :— N1/J2. We thus construct a sequence of consecutive quotients 
M ^ Ni ^ N2 ^ . . . . Notice that by construction, d{Ni) < d{Ni-i) (see equation 
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P9[ ) in each step of the process. Hence the process has to stop m finitely many 
steps, say -/V„ = 0. Now put Mi :— Ker(M Nn-i). Then we get 

(30) M = Ma D MiD M2D ■■■D Af„ = 0, 

with Mi/Mi+i = Ker(iV„_i_i — > Nn^i) ~ L(cr„_i), as desired. □ 
We thus arrive at the following fundamental 

Problem 2.33. For a lowest weight module M over A{k), denote by [M : L{a, k)] 
the multiplicity of L[a) in a Jordan-Holder series of M . Compute and interpret 
the multiplicities [A/(r, fc) : L(cr, fc)]. 

There are many natural questions and problems related to the topics introduced 
in this subsection. One should study the structures that were introduced before in 
the case of P = M{triv) (such as the contravariant pairing, the De Rham complex, 
the singular set) systematically for general lowest weight modules. In addition, one 
should consider the natural analogue of category O in the present situation. Except 
for the remarks below, we resist the temptation to address any of these questions 
here, since this would take us too far afield. The main goal of this paper is the 
study of the special case t = triv. 



Some straightforward remarks are in order. By Proposition 2.31 it is clear that 
if M has lowest G-type r, [M : L(a, fc)] is bounded by the multiplicity [M„i(^r.a) '■ c] 
of a in the degree m(T, a) = Cr{k) — Co-(fc) part of M . In particular we see that 

(31) [M(T,fc):L(T,fc)] = l 
and that for cr ^ r, 

(32) [M(t, fc) : L(cr, fc)] 7^ implies that c^(fc) - c^(fc) e N. 

Hence if we introduce an ordering of G by defining cr > r if and only if Co- (fc) < Cr (fc) , 
then the matrix [M{t) : L{cr)] is unipotent upper triangular. In particular, the 
matrix is invertible. 

Define the r-singular set Kf^^ C -fiT as the set of fc G -fC such that M(r, fc) ^ 



L(t, fc). The description of ig j^^st one part of Problem 2.33 . By the above 

it is plain that fc ^ if for all cr, Cr{k) ~ c^{k) ^ N. The converse is in 

general not true (as we saw in the special case t — triv). We see that K^™^ is 
contained in a locally finite collection of hyperplanes, such that the coefficients of 
the affine linear forms describing the hyperplanes are integral (but with signs). In 
the case where r is the linear character of G whose restriction to Gh is Xh^'^'^^ 
(for some br{G) £ {0, . . . , ch — 1}) if G C, then it follows by formula ^ that 
M{T,k) ~ M{triv,l3r{k)) where f3rik)^j := fcc,j+b,(C) - fcc,b^(C)- In particular, 

2.6. The module P over A(fc). Let us return to the module P = M{triv). In [D 
a polynomial q G P+ was called singular for the parameter fc if T^{k)q — for all 



f G y. In other words, q is singular if and only if g G H^{k) (see subsection 2.3) 
and q(0) = 0. In the language of the previous subsection, a polynomial is singular 
if and only if it is a primitive element of positive degree for the module P. In 
addition, i7°(fc) = PP . 

Recall that, by definition, nonzero singular polynomials for fc exist if and only if 
fc is a singular parameter. The space H^{k) of primitive polynomials for fc is graded 
and is a G-space. For each t e G and degree m G Z+, we denote by iJ^ ^(fc) the 
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space of primitive polynomials for k in degree m and of type r. By Proposition 
|j.31 , we have the relation 



(33) m = ~Cr{k) 

if iJ^j r 7^ Oj showing that H^{k) is finite dimensional. Suppose that H C ^{k) 



is an irreducible subspace. By Proposition 2.3C, the ideal J{H) := PH it generates 
in P is a lowest weight A(A:)-submodule of P with lowest G-type r. 

The form (•, on P is an hermitian contravariant form on the module P over 



A(fc), in the sense of Proposition 2.17| (i) and (ii). This construction can be extended 



to all lowest weight modules, and it plays a role quite similar to the Shapovalov form 
on Verma-modules for a semisimple Lie algebra. We will restrict ourselves to the 
special case at hand, the module P. The radical Rad(fc) :— {p € P \ {p,P)k = 0} 
of this form is a graded ideal of P, which is stable for G and for the application 



of the operators T^(fc) (see Proposition 2.2C and its proof). In other words, it is a 
(graded) A(A:)-submodule of P. 

Proposition 2.34. The radical Rad(fc) of {■,-)k is the unique maximal proper 
A(k)-submodule of P. In particular, P is not irreducible as an A{k)-module if 
and only if k is singular, and P/ Rad(fc) is the unique simple quotient L{triv,k) of 
P. 

Proof. Let M C P be a proper A(/c)-submodule. Because 1 ^ M we have, since 
M is graded, {l,M)k = 0. But this clearly imphes [P,M)k — 0, in other words: 
M C Rad(fc). Thus Rad(fc) is the unique maximal proper A(/c)-submodulc of P. □ 

We are in the position to apply the technique of the Jantzen filtration (see ||l2| , 
Chapter 5), so let us discuss this briefly. Given a real parameter fco G K , consider 
the real line L in K through fco and 0. Note that fc = is a regular parameter, 
hence a generic point on L will be a regular parameter as well. We parameterize 
this line by k{t) (1 + t)fco and consider t as a real indeterminate. Let us denote 
R = M.[t]. For any complex vector space B we denote by Bji :— R (g)R B the free 
Rc — 'C(S)rR = C[t]-module that arises from B by extension of scalars. Then A^^ is 
a free associative i?c-algebra. For r € Rc we define r*{t) := r{t) (recall that t = t). 
Thus * is a C-anti- linear involution on Rc- We have that Pr is a module for A/j. The 
anti-linear isomorphism * : P ^ S extends naturally to an anti-linear isomorphism 
* : Pr — > Sr, where anti-linear means that {rp)* = r*p* . We define a contravariant 
hermitian form {■,-)r with values in Rc on Pr by {p,q)R := {p* {T{k{t))q){0). 
The form is linear in the second factor and anti-linear in the first factor. It is 
hermitian in the sense that {p,q)R = iq,p)R, and contravariant in the sense that 
{xp,q)R = {p,T^'{k{t))q)R, {T^.{k{t))p,q)R = {p,xq)R and {p^,q^)R = {p,q)R- Let 
m-o denote the ^-invariant maximal ideal toq = tRc of Rc- We introduce a sequence 
of i?c-linear subspaces M]j. C Pr defined by: 

(34) A'PR := {p e Pfi I (Pfl,p)H C m^. 



Lemma 2.35. The Af|j form a decreasing sequence of KR-suhmodules in Pr . 

Proof. The sequence Af|j is clearly a decreasing sequence of Pc-linear subspaces. 
The fact that they are submodules follows from the contravariance of (•, •)r. □ 

Let us denote by ij} the specialization functor ^{L) := L/tL (where L is an Rc- 
module) at t = 0. We thus obtain a C-algebra homomorphism ij} : Kr, A(fco). 
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This is compatible with the module structures of Pji and P, in the sense that for 
a e Aji and p G Pr, we have ip{ap) = '4j{a)ip{p). Also, ^/'((p, g)^) = {ilj{p),tlj{q))ko- 
We put 

(35) AP := i!{M}^). 

For a graded subspace M of P we introduce the notation 

(36) Ch(Af) := ^ dim(Af„)X". 

Proposition 2.36. (i) Pr = Af" D Af^ D Af ^ . . . is a sequence of A(fco)- 

(ii) have X]i>o *--'^(^^') ~ X]n>o ^(^('^))"'^"' w/iere D{n) denotes the de- 
terminant of {■,-)fi on Pfi^n (the Rc-module of polynomials of homogeneous 
degree n on V , with coefficients in Rc), and where v denotes the m^-adic 
valuation on the polynomial ring Rc- 

(iii) For i > 0, = 0. 

(iv) For p G , let us denote by p £ Af]j an arbitrary element such that ip{p) — p. 
For allp,q G M^, the expression (p, q)^*) :— ^l;{t^^{p, q)ii) depends only on p 
and q, not on the chosen lifts p, q. The form (■, •)''' is hermitian and A(ko)- 
contravariant on Af% and its radical is AP+^. In particular, — Rad(fco). 

Proof, (i) This follows directly from the above Lemma, by application of ip to the 
sequence Af|j. 

(ii) Since the spaces Pr^u are mutually orthogonal with respect to (•, ■)r, we see 
that M|jjj = {p e Pr„ I {PR,n,p)R G ttiq}- We apply (an appropriately adapted 
version of) Lemma 5.1 of to the i?c-module and obtain that for all n 

(37) ^dimA/; = K^(n)), 

i>0 

where := ip{M}^^) = ^(A/|j)„. Note that D{n) is determined up to a unit in 
Rc, so that v{D{n)) is well defined. The result follows. 

(iii) By (ii) we see that given n e N, there exists a & > such that — 
for all m < n and i > b. Take n > — max^^g, Cr (fco) and suppose that ^ for 
some i > b. Let Z G N be minimal such that ^ 0, and let cr G G be such that 
Ml^ ^ 0. Then mko)Mi^ = for each and thus £'(fco)A//^ = 0. On the other 
hand, the eigenvalue of E{ko) on Ml ^ equals / + Cr(fco) > 0, since I > n > — Cr(fco). 
This is a contradiction. 

(iv) This follows by jlj], Bemerkung after Lemma 5.1. Notice that the expression 
(p, g)*^*-* is independent of the lifts p and q since, if a G Af|j n tP, we have 

(38) (a, A'Pr)r C t{P, APr)r C ml+\ 

When I = 0, we have (■, -Y^^ — (•, ■)ko- Thus the result = Rad(fco) is the special 
case 1 = 0. □ 

We end the section with a hint for the interpretation of the multiplicities Srik) = 
[P = M{triv, k), L{t, k)]. Suppose that G has a Coxeter-like presentation (in the 
sense of Appendix 2) such that its diagram also provides a presentation of the 
fundamental group (the braid group) of the regular orbit space of G. Suppose that 
the cyclotomic Hecke algebra H{G,u) corresponding to the diagram of G can be 
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generated by \G\ elements over the ring Z[u, u The inhomogeneous relations for 
the simple generators of H{G, q) are of the form 

(39) (Ts - uao)(Ts - uc,i) ■ ■ .{Ts ~ uc,ec-i) = 

where s is a reflection in a certain cyclic group Gh with H G C G C, with determi- 
nant det(s) = exp(27rz/ec)- Let us now view the parameter value uc,j as a function 
of the parameters kc,j as follows 

(40) uc,j qc,] := exp(27ri(j - ecfccj)/ec)- 

We extend the ring of definition of H{G, q) to the ring R of entire functions in the 
parameters kcj via this substitution. The resulting algebra is denoted by H{G)r. 
It is known that the Hecke algebra H{G)k over the quotient field K oi R\s split 
semi-simple (see Corollary 6.6), so that we can uniquely parameterize the 

irreducible representations tTt- of H{G)k by the irreducible representations r of G. 
Let U denote the principal indecomposable block of the trivial representation in 
the TO-adic completion H[G)m of H{G)ii, and let Km denote the quotient field of 
the ring Rm of formal power series in k centered at v. The results and method of 
|8) seem to suggest that the multiplicities 5'^{v) defined by 

(41) Km®U = ®^^a^'r{v){Km®{-Kr)m) 

are related to the multiplicities (5r(f) if vc.j < for all C,j. 

In the next section we will turn to the study of the infinite family of imprimitive 
groups. The set X*™^ will be described in detail for this class of complex reflection 
groups. 

3. The groups of type G{m,p,N) 

3.1. Introduction. In this section we study the particular case of the complex 
reflection group called G {m,p, N), which is a finite subgroup of U (N). Because 
of its close relation to the symmetric group it is possible to perform a detailed 
analysis of the Dunkl operators (constructed for real refiection groups in ^), the 
pairing, and the analogues of the nonsymmetric Jack polynomials. In fact, the 
special case G(2, 1,A^) is exactly the hyperoctahedral group (type B), and the 
results of one of the authors (Dunkl 1^,0) on type-i? polynomials motivate the 
methods used in this section. Some of the notation used in the first section is 
changed here to a mode better suited to deal with monomials and permutations. 
The fundamental objects are polynomials in x — {xi, X2, ■ ■ ■ , xn) G (considered 
as coordinate functions); the group is realized as a subgroup of the matrix group 
U (N) acting on the row vector x. For a multi- index (composition) a G Nq let 
\a\ = X]i=i '^i ^^-d let denote the monomial Jli=i ■ To a permutation w G Sn 
(the symmetric group on N letters) associate an N x N permutation matrix with 
I's at the {w (j) ,j) entries. The action on x is given by (xw),^ — x^(^iy, the action 
on polynomials is wp (x) = p (xw). Thus the action on monomials is w {x") = x™" 
where {wa)^ = am-i(i) (consider a as a column vector). The symmetric group 
contains the transpositions (i, j), for i ^ j, defined by 

(^j j) — ... ,Xj, . . . , Xi, . . . ^ . 

For a fixed m = 2, 3, . . . let 77 = e^'^'/™, an m*'* root of unity, then the complex 
reflection group W of type G (m, 1, TV) consists of the N x N permutation matrices 
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with the nonzero entries being powers of rj. The group is generated by the trans- 
positions + 1 < i < N — 1, and by the complex reflection rjv where is 
defined by 



for \ < i < N . The powers arc also reflections. Thus t/.x" = ry**"*.!" for 
a G fi^ ■ The symmetric group Sat is obviously a subgroup of W . The group 
W acts on polynomials by wp {x) = p {xw) for w G W. There are some obvious 
commutation relationships: (where Xt denotes the multiplication operator) 

(i,j)Ti = Tj (ij), 

and the elements r~* (hj) Tf are ordinary (period 2) reflections in W. In terms of 
root vectors v ^ 0, such a reflection is given by xa^ = x — 2 {{v,x) / ||f|P) v (where 
the hermitian inner product is {x,y) = X^^Li^iJ/j ^^'^ the norm ||a;|| = {x,x)^^^). 



Definition 3.1. For 1 < i < N let ei = (0, . . . , 0, 1, 0, . . . ) denote the standard 
unit veetor of C^. For i ^ j and < I < m — 1, let v^'^^ = — rj^'^Cj, and 
i?o = i^vfj : 1 < i < j < N,Q < I < m - ly 



For V = v^^j the reflection equals r^^' {i,j)Tl. Similarly xtI = x — (I — 77') 
{ei,x)ei. To define the Dunkl operators introduce m parameters Ks,0 < s < 
m — 1. In the notation of the Section 2, the class Co is {v-^ : v S i?o} and Ci = 
^iLi {x Xi ~ 0}, further = 2, kc„ = kq and = rn, kci,s = i^s for 1 < s < 
TO — 1. The functional an = {v,') where the hyperplane H = v^. 

Definition 3.2. For 1 < i < N let 

J^iil s=0 t=l S=0 

where the divisions are understood to follow the numerator operations. 

Note that Tj is the same object as T^^ {k) ; the nature of the group W makes it 
desirable to use coordinates. The action can be expressed in another useful way. 
Define associated projections on polynomials by the linear extension of 



TTj (S) X° 



x" if ttj = s mod m 



else 



for 1 < j < A'' and s G No . The projections can be expressed as tt^ (s) = sh. 
m X]t:0^ r]~''^T^ (in the section 2 notation, where Hi = {x : Xi = 0}). 

Proposition 3.3. For a G and for 1 <i < N: 



Tix" = o-a;" + mKo ^ tt^- (a^ ) 



+ 



Qxi . Xi Xj 

mKsX°'/xi if ai = s modm and 1 < s < m — 1 
if ai = modm. 
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Proof. The part involving (period 2) reflections (kq) is proven using the following 
formulae: (stated for i — 1, j = 2, which suffices) 



(42) ^^^2 LLii^L^^sign(ai-a2) V 

I— miii(ai ,Q2) 

and for any s with < s < rn — 1, we have 

a;ra:r-rr(l,2)rfxrxr ^ ^-... xf (ry^x^)"- - (r?-^^)"^ 

Xl - 77^X2 Xl - 77^X2 

max(ai ,02) — ! 

= sign(ai-a2) ^ <^+"^-*-^x*r;^(*-"=); 

f— min(ai ,02) 

now the sum over 0<s<m— lin effect applies m7r2 (q!2) to the sum in formula 
E2I. □ 



Remark 3.4. The complex reflection group G {m,p, N) (defined when p divides 
m) contains the reflections rf'' {i,j) rj (for i < j and < s < m — 1) and t^^ for 

l<i<N,l<s<^ — I. The appropriate modification of {Ti}^^-^ is to require 
Ksm/p = and Kt+sni/p ^ for 1 < s <p~l and 1 <t < ^ -1. 

Proof. Let Cg = Sjli^ Kjri~^^ for < s < m — 1, then c^. is the coefficient of r? 
in the formula for Ti (for any i), and 1 < s < to — 1. The inversion formula is 

Kj — X^rio '^sV"'' foi' J ^ 1; and X^rio ~ condition Cg — unless 

s = Omodp is equivalent to the periodicity condition on the values of Kj stated 
above. □ 

We refer to the list of residues mod to of the index a as the parity type and say 
that x°' and have the same parity type if = mod to for 1 < i < iV. If each 
monomial in a polynomial has the same parity type then we say the polynomial has 



that type. Proposition 3.3 implies that if a polynomial p (x) has the same type as 
x" for some a e then Tip (x) has the same type as x°'x^^ (or a;"x™~^ if a; — 0). 
Thus the operators {TiXi}^^^ preserve parity type. We will define an inner-product 
structure on polynomials in which these are self-adjoint. Just as in the symmetric 
group case they do not commute but can be modified to form a commutative set. 
First we need to calculate the commutant [xj, Ti] = XjTi — TiXj. 

Proposition 3.5. For i ^ j, [xj , Ti] = kq Y.T=o^ V^Ti" {hi) ■ 

Proof. Use the definition of Ti and consider XjTi — TiXj. The terms involving 
differentiation and transpositions {i,t) with t ^ i,j cancel, leaving only 



m— 1 

XjTi TiXj — kq ^ ^ [ X 

s=0 



1 - 7-, ' («, j) t/ Xj - "(ij) Tfxj 



r]^Xj Xi — •q''Xj 



m— 1 „^ m — 1 

This completes the proof. □ 
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Corollary 3.6. For i j the following hold: 

m— 1 

[TiXi,TjXj] = Ko {TiXi - TjXj) (*'^>/' 
TiXi,TjXj - Ko Tj ' r/ 



s=0 

0. 



Proof. Indeed 

TiXiTjXj TjXjTiXi = Tj, i^xiTj TjXj^ Xj Tj (^XjT-i T^Xj^ Xi^ 
and by the Proposition 



m— 1 



Ti {xiTj - TjXi) Xj = KoTi J2 v'Ti ' r^Xj 

s=0 
m— 1 

s=0 
m— 1 



s=0 

and similarly Tj {xjTi — TiXj) Xi = n^TjXj X^l'lo^ '^i'^ (*> j) Finally observe that 

EiiT/ -r^ < = E^o' ^r^T/ = Eiro' ^/^r j) = Er=o' j) ^/ 

(by changing the index of summation from s to —s and using the relation TjTj = 

TjTi). 

Furthermore the commutant satisfies [Tja;^, t~* (i, j) ] = TiXiTj"^ {i,j)Tj — 
tJ"^ TjTiXi = TiXiTj^ Tj — TjXjTj^ Tj for each s, since Tj commutes 
with Tj- a; J. □ 

Definition 3.7. For 1 <i < N define the operators 

m— 1 

Ui = TiXi - «0 XI m (^'•^^ '^i- 

j<i 8=0 

Theorem 3.8. U,U^ =WjW^. 

Proof. Let A^t = El=^^ '''r" '''r = J2"=o^ ^t^ (''i ^) '^t'- Suppose that i < j, then 

we have [U„Uj] = [TiXi,TjXj - KoKj]-KoJ2r<j,r^i [TiXi,Xrj]-KoJ2r<i [Ki,TjXj] + 

'^0 Er<i il^ri, ^rj] + [Ari, Ay]) . The Commutators [Ari, \tj] with t ^ r.i vanish. In 
the previous expansion all terms but the last are zero (by the Corollary). For 
r < i < j (this computation is in the group algebra CW) 

m—l m — l m — 1 

AwA.,- = J2 ^r' {r,i)r: J2 ^i' ('"'J')^! = E ^r'rt+'Tr' {r,i) (r, j) 

5=0 t^O s,t^O 

m—l m — l m — l 

s,t=0 t=0 s=0 

= XijXrij 

and similarly XriXij = XrjXri- Thus [A^, A^j] + [Xri, A,j] = 0. □ 
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The group algebra elements J2r<i (^'^'^ 1 < i < N) are the analogues of the 
Jucys-Murphy elements for the symmetric group. The inner product we will use 
is the pairing {p,q)f. = p* {T)q(x) \x=o, which means that the operator p* (T) , 
obtained from p* (x) = p (x) (each coefficient of p is conjugated) by replacing each 
Xi by Ti, is applied to the polynomial q (x) and the resulting polynomial is evaluated 
at a; = 0. Obviously if p, q are homogeneous of the same degree then p* (T) q (x) is a 
constant (degree 0); and if p, q are homogeneous of different degrees then {p,qh. — 0. 
Of course this is the coordinatized form of the general definition given in [l6[ The 
known results for Sn are used to analyze the action of Ti by factoring polynomials 
into a "parity part" and a part invariant under the complex reflections Ti . Introduce 
a new variable 

Say that a composition a G Nq is a parity type if < < m for each i. If all the 
terms of a polynomial p (x) have the same parity type then p can be expressed in 
the form p (x) — x'^g (y) for some parity type a. The tyj>e-A Dunkl operators (see 
Section 8.3 in the monograph ^ by Dunkl and Xu) are defined by 

d , , 5(2/) - {hj)9{y) 



T^rg iy) = jr-9 iy) + '^o XI ■ 



for I < i < N (using the same notation for the transpositions acting on y as 
on a;). Often we write ^y.^ly^ 9 (y) for the inner term. 

Proposition 3.9. Suppose g (y) is a polynomial and a is a parity type then 

1. if ai > then 

Ttx"g (y) = mx"x~'^ - 1 - kq E («, j) 5 (2/) ; 

2. ifai^O then T,x°'g (y) = mx'^x'^^^Vig (y) . 

Proof. Suppose > then TiX°'g{y) = {ai + mKai) x" x^^ + mx°'x™'~^ -^g (y) 
+ ruKo Ej, where (for j ^ i) 

I -.x^giy) - {i,j)x°'g{y) 

= TTj{aj)[x f-— — —g{y) + — z — I ihj)9{y) 



yi Vj Xi 



X 



For the first term note ttj {aj)x°'— — ^ = ttj (aj) a:" 'x)^ ccf = x'-^'^x" 

Xi Xj s—Q 

By formula ^ (with 1, 2 replaced hy i,j) 



X \h j) X . I , \ Q ai—s—l s—OLi 

= sign(Q!i - aj) 2^ X x^' X- ' 



inax(ai.Qj) — 1 
s— inin(Q^ 



(note that the power of xj is s) and it follows that ttj (aj) ^ — x"x^^ if 

ai > aj and = if < aj; if ai > aj then the summation extends over < < 
s<ai — l<m~2 and the projection tTj (aj) picks out the term with s — aj, and 
when ai < aj the case s = aj cannot occur. Also T>iyig (y) = <? (y) + yi-^9 (y) + 
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^ yi9 (y) - Vj {i, j) 9 (y) At-u ■ ^ i (\,r ■^ /\ 

Kg > and tne inner term equals jji g (yj + («, j) g (y)- 

yi - V] yi ~ yj ' 

Consequently, for each j ^ i we obtain the equality x"x"^~^ — 9 (y) — 

yt-yj 

x'^xj^y.i- — ^^^g (y) = x°'x~'^ (- — ^^^^yig (y) - («, (y) ) • The transpositions 
y» - Vj \ Vi- yj J 

for ai > aj are cancelled out. 

If at = then TiX°'g (y) = mx"x™~^ -^g (y) + mno ^ Ej with the same Ej as 

before. The case at > a, can not occur so that E^ — a;™^^x" ^ — q (y). This 

completes the proof. □ 

3.2. Simultaneous Eigenfunctions. We use the nonsymmetric Jack polynomials 
from the type-A machinery to produce a complete set of simultaneous eigenfunction 
for the commuting operators {Ui : 1 < « < N}. The nicest case is for polynomials 
of standard parity type" , that is, of the form x^g (y) such that i < j implies 
ai > aj. This means that in the list (ai, a2, . ■ . , ajsf) the values = m — 1 appear 
first, then the values ai = m — 2 and so on until the end of the list composed 
of = values (roughly (m — 1, . . . , m — 1, to — 2, . . . , to — 2, . . . , 0)). Not every 
value need appear, of course. First we restate Proposition 3.9 for the commuting 
operators. 

Proposition 3.10. Suppose g{y) is a polynomial and a is a parity type then 

1. if Q < ai < m — \ then UiX^g (y) = 

= mx" I + ^ _|_ ^^^^^ ^ x),yi - 1 - kq [ J2 + E jihJngiy); 

\ ^ yaj>Qi j<i,aj—ai J I 

2. ifai^m-1 then U^x'^g (y) = mx"^ V^yi - kq J2 j) ] 9 iv) • 

\ j<i,aj —m — 1 / 

Proof. For any /3 G we have J2TJo^ t'' {i,j)Tfx'^ = J2T=o^ V''-'^'"'^'^ 

= m{i,j)x^ if Pj = /J^modm and else equals 0. Thus the second part of Ui 

contributes — kq E {hi)9i.y) (and {i,j)x°' — x°' for such j). When ai = 

j <i.aj—OLi 

TO — 1 then write x^a;" as x^x^^^^yi and use part (2) of Proposition 3.!;. □ 
Following Definition 8.3.4 in the type-A (commuting) operators are defined 



by 



^/^ Ayi + Ko - Ko ^ (i, j) 

j<i 



The nonsymmetric Jack polynomials are defined by means of a partial order on 
compositions. 

Definition 3.11. For ^^v ^ the relation ji ^ v means Ei=i l^i — Ei=i '^i /"'^ 
each j and fJ. =/= v (dominance order); /i+ is defined to be the (unique) partition wfi 
(for some w G Sn: that is,l < i < j < N implies (At~'")j > )> '^^'^ M > 

means ~ \v\ and /i+ >~ or /i+ = and fi )^ v. 
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Define a convenient basis {p^ : /i G N^} for homogeneous polynomials (see [^) 
by the generating function: 

TV f N 1 

with the useful property that /i^ = implies P^p^^ = 0. For each /i G 
there is a unique simultaneous eigenfunction of {Uf^}^_^ of the form = P/^ + 
{"^T f^) Pi' (where B{v,ix) G Q (kq) and does not depend on N provided 
that iV > M and Ati = for all i > M). See Theorem 8.4.13 in [|. 

Then C^. iv) satisfies W/'Cm iv) = Cm iv) for ^J. <E and 1 < i < N; where 

the eigenvalues are given by 

£.1 (m) = ko{N {j : /ij > n,} - # {j : j < i k fij ^ ^J) + /i.^ + 1. 

Suppose P G Nq then there is a unique parity type a and a composition 7 G 
so that (3 — a + 171"/ (as vectors; that is, Pi — ai + m"fi and 7^ [/Ji/mJ for each i). 
We will construct a simultaneous eigenfunction for each /?. When a is a standard 
parity type the nonsymmetric Jack polynomials work directly. 

Proposition 3.12. Suppose a is a standard parity type, g is any polynomial in y, 
and 1 < i < N , then 

1. i/0<a, <m-l thenU,x''g{y) = mx''{^ + Ka.,+i-KQ-l+U^'^)g{y); 

2. if ai — m — 1 then UiX'^g (y) = mx"' (Uf — kq) g {y) . 

Proof. By definition of standard parity type, for any i the set {j : aj > ai} U 
{j : j < ik aj = ai} is exactly the set {j ■ I < j < i} ■ □ 

Corollary 3.13. Suppose a is a standard parity type, and 7 G then 

1. UiX^Cj (y) = m - 1 + Ka,+i + £,i (7) - kq) x^Cj (y) when <ai<m- 

1; 

2. UiX^Cy (y) = m (fi (7) - Ko) 2:"C7 (y) w'^en = to - 1. 

Suppose a' is any parity type, but not standard. The idea is to use a permutation 
which maps a' to a standard parity type in such a way that the original order of 
coordinates with the same value of a'i is preserved. For technical reasons it is easier 
to do this backwards. Suppose that a is a standard parity type and suppose w G Sn 
(a permutation) and has the property that 1 < i < j < N and ai = aj implies 
w (i) < w {j). We will show that wa:"C/3 {y) is an eigenvector of each Ui. We use 
the transformation properties (holding for any w G Sn) : wViyi ~ T^w{i)yw{i)W and 
(r, s)w — w {w~^ (r) , (s)) for r ^ s (the action of permutations is as follows: w 
is an N X N permutation matrix with I's at the (w (i) , i) entries, x is a row vector, 
compositions are column vectors; so that w {x") = x'^°' where iwa)^^^^^ = ai for 
any i). In the following wx°'C,ry (y) is the polynomial x^'^C,^ (yw) (with parity type 
wa). 

Proposition 3.14. Suppose a is a standard parity type, 7 G N^, and w G Sn has 

the property that w (i) < w (j) whenever I < i < j < N and ai — aj, then 

1. Uw[i)wx°' C,^ (y) = TO - 1 + Ka^+i + £i (7) - Ko) wx°'C^ {y) when < a; < 
TO — 1; 

2. U^(^i)WX°'Cj (y) = TO (^j (7) - kq) wx^Cy (y) when ai = m ~ 1. 
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Proof. Suppose < m—1 then part (1) of Proposition 3.10| applies (and note that 
= Q^*) ^^^^ 



where the set E = : {wa). > U : j < w (i) & (wa). = (u'a)^(-)|. 

But J2 {hW^ U)) = I] (*'^) = I] (^'■s)' and w"i£; = {s : as> a,} U 

{s : w {s) < w (i) Szag — ai} . By the condition on w, the set w^^E is equal to 
{s : 1 < s < Indeed, consider any j < i\ aj < ai is impossible by definition of 
standard parity type so aj > af. furthermore if aj ~ ai for some j then j < z if 
and only if w (j) < w (i) . The proof of part (1) is now completed similarly to the 
proof of Proposition |3.12 . 



The proof of part (2) is an obvious modification of that for part (1). □ 



3.3. Evaluation of the Pairing. We recall some facts from Proposition 2.17 and 



Theorem 2.18 



Theorem 3.15. The pairing (•, ■)^, has the following properties (with p,q € Vn)' 



1- (g,P)fc = (P,9)fc ; 

2. [TiXip, q)k = (P, TiXiq)^. for 1 < i < N; 

3. {wp,wq)f^ — {p,q)f. for any w G W. 

Proof. From the definition it is clear that (j),TiXiq)^ = {xip, Xiq)i^, and by part (1) 
we have {TiXip,q)f, = {q,T^Xip)^ = {xiq,Xip)f^ = {xip,x^q)f^ . 

For the real case (m = 2) there is an associated inner product with respect to the 

measure Jlili Nil^''^ ^i<j ~ ^'^\^'^° ^-'^P (~''^) (^^^ '^^ Theorem 

5.2.7 and Section 9.6.3 in [^). It is an interesting question whether there is a 
similar situation for the complex group. □ 



By the properties of the pairing in Theorem 3.15 there are obvious orthogonality 
relations. 

Lemma 3.16. The operators Ui are self-adjoint for (•, 



Proof. The reflections a — ihj) ^i are self-adjoint (by part (2) of Theorem B.15 



because = 1. By part (3) of this theorem TiXi is self-adjoint, thus, Ui is also. □ 

Proposition 3.17. Suppose a,P are parity types and £ then: 

1- {y) ,92 (y) are polynomials and a ^ (i then {x^gi {y),x'^g2 (y)) ^ = 0; 

2. if fi ^ v and a is a standard parity type then (a;"C^ (y) , x°'(^i, (j/))^. — 0. 

Proof. For part (1) suppose ai ^ (3i for some i then {x" gi {y) , x^ g2 {y)) = 
{nx^gi (y) ,T,x^g2 (y))^ = r^ft-". (^x^gi (y) ,2:^52 (y))^. and ry/'.-a. i 
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For part (2), suppose that /i^ ^ Vi for some i. By Lemma 3.16, we have the 
equahty {UiX°'C,^ (y) ,x°'(^ {y))^, = (x^Cm iv) MtX'^C,^ iy))k- "^^^^ proves the claim, 
because the two polynomials are eigenfunctions with different eigenvalues. □ 



For other parity types see Proposition 3.14. To do the nontrivial pairings we 
collect some facts and notation from the Sn case. An element A e Nq is a partition 
if Ai > A2 > • • • > Aat. For any 7 g let 7+ be the unique partition such that 
7+ — w'j for some w E Sn- For 7 e Nq and e = ± let 

For a partition A and indeterminate t (and implicit parameter kq) the generalized 
Pochhammer symbol is defined by 



N 



where (a)^ = 1 and (a),^^j^ = {a)^_^{a + n); further suppose Xm > Xm+i = (or 
M = N) then the hook length product is 

h{\t) ^Y[Y[(X^-j + t + Ko#{s ■.s>ikj< AJ). 

For < ^ < TO — 1 and 1 < i < to — 1 define the indicator functions Xi (0 — LIJ ^^"^ 
extend coordinate-wise to parity types, that is, Xi {ct) ^ ^0 ^-nd {xi = Xi (o^j) 
for each j. The rest of the section is mostly concerned with proving the following. 

Theorem 3.18. Let a be a standard parity type and let 7 G N^, then 

{x^C, (y) , 2:"C7 (y))k = mi^i+^i^i J] (iv - 1) ^0 + - + « 



1=1 



(7+Xi(a)) + 



The argument has three main steps: 

1. find {x'^t^^ (y) , x^C^ (y))^ in terms of (C^ (y) , C7 {y))^ ; 

2. find (C7 (y) , C7 iy))k te™^ (C^ (y) ' Ca (y))fe, where A = 7+; 

3. find (Ca (2/) ,Ca (y))fc in terms of (Ca-em (?/) : Ca-em {y))k where Am > and 
Xm+1 = ot M = N. 

The formula is valid for the trivial case a = = 7. The method of proof is 
to assume the formula for lower degrees and show the above mentioned ratios are 
consistent with the formula. 

Proposition 3.19. Let a be a standard parity type and let 7 £ Nq then 

Proof. We reduce the degree of x" by one at each step so that each intermediate 
stage is a standard parity type. Suppose that as — I > a^+i for some s, or s = iV 
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and I > 0, then {j : j ^ s, aj > 1} — {j : j < s}. By Proposition 3.£ 




j<s 



(7) - 1 - C7 (2/) 



(because Vsys - kq J2j<s U' = - '^o); recall (7) ^ ko{N~# {j : 7i > 7s} - 
# {j : 7j — ^s<kj < s} + 7s + !)• There is a unique w £ Sn such that = 7+ 
and i < j and 7^ = 7^ implies w (i) < w{j). We claim that w(7 + xt(a)) = 
(7 + Xt (a))^ for 1 < t < TO — 1. We must show that 7^ + xt (oi) > 7j + Xt (ctj) 
implies w (i) < w (j); the condition is equivalent to 7^ — 7j > Xt (a^) — Xt (^i). If 
Xt (c^j) -^i Xt (o^j) then 7^ > 7^ and w (i) < w (j). By definition of standard type 
the finite sequence (xt is nonincreasing (a partition), thus Xt (ctj) < Xt (aj) 

implies Xt (oJi) = l,Xt ("j) = and i < j. So 7^ + 1 > 7^-; if 7^ > 7^- or if ji = 7^- 
and i < j then w (i) < w (j). 

Let /3 = a - (the parity type of TsX°'C^ (y)), then xt (/?) = Xt (a) for ^ 7^ 
L By the claim the only difference between (7 + Xt(c^))^ and (7 + Xt(/5))^ is 
(7 + Xt ia))t(^,) = 7, + 1 = (7 + Xt (/3) + 1 (also note that (7 + xt ia))tu) = 
(7 + Xt s-r^d similarly for Up to a factor depending only on 7, and where 
Ci denotes the factors involving 7 + Xt (ct) for t ^ I which do not change from /3 to 
a, T^x^(j (y) equals 

N 



Cim^^\l[(iN-i)Ko + ^ + ^i] 
= Gml^l n - 0')) «o + - + «i 



(7+Xi(/9)), 

By construction 7+^.^ = 7^ and thus (7) = ^«;(s) (7"^) = {N - w (s) + 1) kq + 
7s + 1. We showed that T^cc^Ct iv) = w + '^z + 6 (7) - 1 - ^o) x^^C-y (y) = 
TO (A + 7s) x'^C^ (y), where A = ^ + k; + (A^ — w (s)) ko- This is the desired fac- 
tor since (7 + Xi (/3))s = 7s and (A)^^ (^ + 76-) = and (7 + Xi (a))^(s) = 
(7 + X/ (<^))s = 7s + 1- This process is used repeatedly to find T°'x°'C,^ (y) as a 
multiple of (y). □ 

We state the definition of an admissible inner product (•, •) on polynomials associ- 
ated with Sn- For polynomials gi (y) , 172 (y) we require that (1) {gi (y) , 52 (y)) = if 
51,52 are homogeneous of different degrees, (2) for any £ Sn, {wgi (y) ,^52 (y)) = 
(51 (y) , 52 (y)) and (3) {Viy,gi (y) , 52 (y)) = (51 (y) , ^^iy»52 (2/)) for 1 < i < TV. The 
pairing (•, is permissible; the first two properties have been established already, 
and by Proposition |3.9| we have TiXig (y) — m + ki — 1 -I- I?iyi) 5 (y). This 
proves property (3). The following is a consequence of Theorem 8.5.8 in 

Proposition 3.20. Suppose 7 e . Then we have 

(C7 (y) , C7 {y))k = ^+ (7) ^- (7) (C^+ (y) , iy))^ ■ 

Next we consider the problem of lowering the degree of (^\ for a partition A. 
Suppose that Xm > — Xm+i (where Aat+i = 0; by using several results from 
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Section 8.6 in B we will compute (Ca (z/) , Ca (y))fc ^ .^^^ starting point is the 

(CA-e„ (y),CA-eM 

equation (t^Ca (y) , t^Ca (y))^ = (^^^(JT^jCa (y) , Ca {y)\ = {yMT^iCx iy) , Ca {y)\- 

We claim that T™Ca (y) = m^i^A^^MCA (y), where 

™-i / i \ 
Kx^l[(- + Kt + {N~M)Ko + XM-l]- 
t=i ^"^ ^ 

Indeed, T^Qx (y) = mx^f^VMCx (y)- By Lemma 8.6.3(ii) of |^ we know in addi- 
tion that Dm Vm 'DmCx (y) = [[N - M) kq + Am) ^?mCa (y)- By induction suppose 
that 

m-l . . 

TliQx (y) = m" n f _ + + (AT _ M) ^0 + Am - 1 I xr,-"PMCA (y) • 

t=m-n+l ^ ' 



Then 



I'M -^MSA — '"-^M 



m — n 



Tmx^-"PmCa (y) = ma;™-"-^ + + Vm yM - 1 2?mCa (y) 



+ {N- M) no + Am - 1 j 2?AfCA (y) , 

where we let n take the values 1,2,... , m — 1 in turn. 

Suppose that 61a/ = (1, 2) (2, 3) . . . (M - 1, M) e S'jv is a cycle. Denote by 
A = dM (A - em) = (Am - 1, Ai, A2, . . . , Am-i, 0, . . . ). By Theorem 8.6.5 of [| 
'DmCx = ^a^mCaj where 6a = [N — M + I) kq + Am, and by Lemma 8.6.2(iii) 

{yM'DMCxXx)k = — -^^1 — ^A (CA,CA)fe- Combining these equations we obtain 
Ko + Aa/ 

{TJSCx (y) , n}Cx {y))k = "^'"^1 {VmCx.VmCx)^ - {yMruCx (y) , Ca (y)), 

= m"ifA [yu 2?a/Ca, CA)fe = m"j^A&A (Ca, Ca)^ , 

Ko + Aa/ 



and thus 



(Ca,Ca), = ™™i^A6A^^^^ fe^CA,^^M^CA), 
AAf 

^ ™™if,6A^^^^ (Ca-.„,Ca-s„), f+ (a) (a) , 

because (^a/Ca, ^a/^Ca)^, = (Ca,Ca)j, and ^A^ = A— £a/- Now notice that ^A^ — 

71,^9 I 1 + TTT ^ — "T ; — I for e = ±, and it can be shown (see Section 

8.7 of @) that 

ko + Aa/^ ^ /~\ (A, + 1) (A - £m, 1) 



\m ^ ' ^ ^ h{\- Em, ko + 1) /i (A, 1) 

Fmther = '/^ ^° ^ ^ ^ ^^^^ and 5a = ^^^^ . This 

completes the proof of Theorem 3.18| . 

We turn to skew-symmetric polynomials in y. Suppose A is a partition with 
all distinct parts, that is, Ai > A2 > . . . > Xn > then the polynomial ax — 
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Eu,GSjv '^^S'^ (^) ^'^^ ^weSN ^^g" g Ci^'^ ^'^ skew-symmetric (that is, 

{i,j)a\ = —a\ for any transposition), where = (Aat, Aw-i, . . . ,Ai); further 
{ax,ax)f. = N\£- (A^) (CajCa)^ (see Theorem 8.5.11 in [^). For the minimal ex- 
ample A = ^ = (A^ — 1, iV — 2, . . . , 2, 1, 0) the polynomial ag has the simple form 

ni<,<j<^ {y^ - yj) and £- (5«) - ^ll^^^^^l^y Let - (1, 1, . . . , 1) G and 

for any < t < m — 1 let / (a;) = a;*^ Y\i <i<j <N i^T ~ ^T) (so that the parity 
type is (i, t, . . . , <) . Specializing Theorem |3.18 to 7 = (5 and a = tw, note that 
as (y) = Eu,eSiv ^ig^ (^) ^'^'5 and thus 

T'^x'^as {y) - ^ sign (u;) (T*'^:^*'^^ (y)) 
* ((Ar_i)K„ + + 



m 



11 °^ 



((iV-l)Ko + ^ + «^), 

which implies 



1=1 ^ 

m-1 ^ . X 

n [{N-1)ko + - + kA {Nko + 1) 



m — 1 

X 

i=t+l 



We used the fact that (/, g) / (Ca, Ca) is the same in any permissible inner product 
for each /, 5 G span {C^a : w G Sn} and the value of {as, as) / {Cs, Cs) from Theorem 
8.7.15 in Q. The formula was conjectured by P. Hanlon in 1995. 

3.4. The Radical. The radical for the hermitian form (•, is the linear space 
Rad(K;) of polynomials p such that {q,p)j, = for any polynomial 9; the space 
depends on the parameter values kq, ki, . . . , n„i-i. For the group G {m,p, N) the 
set of singular values (when Rad (k) 7^ {0}) can be explicitly stated with refer- 
ence to the discriminant. Briefly, the radical is nontrivial exactly when any of 
the linear functions occurring in (/, /)^, take on values in 0,-1, —2, —3 . . . where 
/ = (a:ia;2 . . . a;jv)™~^ I\i<i<:j<N i^T ~ ^T)' "^^^ proof of this requires extra care 
when kq G — N because some of the nonsymmetric Jack polynomials fail to exist 
for such values. By careful analysis of their construction one sees that the poles 
can occur only at values of the form ukq -|-/ = 0forl<n<7V and Z G N. In the 
following K refers to the parameters ('«i)™Q^ 

Definition 3.21. Let = {n : = ~{ - I : I ^^0,2 < j ~ I < n < N] and let 

ICi = yJTJi ^n=o {« : "A^o + ;^ + G -No} . 
We claim the set of singular values is /Cq U /Ci . 

Firstly, suppose k ^ /Co and kq ^ — N; in this case all the functions (a exist, 
the simultaneous eigenfunctions of span the polynomials and the pairing 

formulae are valid. If k G /Ci then there is a (nonzero) polynomial x"Ca (y) (some 
standard parity type a, a partition A) which is orthogonal to each polynomial, thus 
in Rad (k). On the other hand, suppose there is a nonzero p G Rad (k) then expand 
p in terms of the eigenvector basis and let wx°'(^j (y) appear in the expansion with a 
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nonzero coefficient (see Proposition 3.14); by the orthogonality relations this implies 

{x^^j [y) ,x°'(j iy))k ~ ^ ^^'^ ^^^^ ^ ^1- 

Secondly, suppose k £ /Ci and kq = I ^ — N; but K-i is closed so take a sufficiently 
close k' e ICi with Kq ^ — N (in the same component as k), for this value there 
is a nonzero polynomial p (a simultaneous eigenfunction) in Rad(K); for some 
n = 1,2,3, .. . (kq — l)" p has no poles and a nonzero limit at kq — I- For any 
polynomial q we have ((?, (to — l)"p)i^ = for all k' close to k, thus Rad (k) is 
nontrivial. 

Thirdly, let k G /Cq; by the results in |^ there is a nonzero polynomial g (y) of 
least degree in the type-A radical, which implies Vig (y) = for 1 < i < N. By 



Proposition 3.9 Tig [y) = for all i and so g {y) G Rad (k) . 

It remains to show that if k ^ /Co U /Ci and kq G — N then Rad (k) = {0}. 
The problem is that the simultaneous eigenfunctions of \Ui\^^i no longer span the 
polynomials; nevertheless it is still possible to give an argument based on triangu- 
larity properties. We will show that k ^ /Ci and Rad (k) ^ {0} implies k G /Co- 
Suppose that p G Rad (k) and p ^ 0; because Rad (k) is an ideal the polynomial 
g (y) = x"p (x) G Rad (k) (if the parity type of p is /3 let = m — /3j for each i). 
Suppose that go (y) G Rad (k) and has minimal degree (among polynomials in y). 
Consider the polynomials Tjgo (y) — mx™~^'DigQ (y); if each P^go — then go is 
in the type-A radical and k G /Co- Suppose not, we may assume I?igo (jj) 0. By 
Proposition U Tl^go (y) = m'» n"7' + ^» + " l) ^i5o (y)- We now use 
the fact that I?iyi is triangular (see p. 454 in Q) with respect to the partial order > 



(see Definition 3.11). Let cy'* be a nonzero term in ©i^o with maximal (for [>) 7;this 
implies that the coefficient of y'^ in T^go (y) is m™ Hta (m ^) where 

= Ko (A^ — 1 — # {j : 7j > 7i})+7i; the hypothesis k ^ /Ci implies ^ + Ki + v ^ 
for each i but then T^go (y) is a nonzero polynomial in y in the radical and of lower 
degree than go, a contradiction. 

Thus the detailed knowledge of type-A polynomials makes it possible to describe 
the set of singular values for G {m,l, N) and inde ed fo r any G {m,p, N). For the 
latter impose the periodicity conditions in Remark 3.4 on k. 



3.5. Shift Operators. Suppose G is a complex reflection group and recall the 
definitions of Section 2. Let p be a G- invariant polynomial, and C a G-orbit of 
reflection hyperplanes. Given a rational function / on we denote by m(/) the 
operator "multiplication by /". Observe that, for s G N with s < cq, the operator 

^(U^h) °P*(r(fc))om( n «h) 
Knee ) Khgc ) 

has the property that it maps P'^ to P*^. 

Question 3.22. Is the above operator on P'^ equal to the restriction to P^ of an 
operator of the form p* (T (k')), where k' is obtained by incrementing some of the 
values of k ~ {kc,i)? 

This is well known in the case of real reflection groups ||ll| . and in that case the 
relation plays an important role in many applications [ p^ . The proof of this "shift 
relation" is based in this case on the presence of the invariant p = J2^i of order 
two. For this invariant the relation can be checked by simple direct computation. 
Then one remarks that this forces the relation also to be true for the higher order 
invariants, using representation theory (see Q). 
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We do not know of any general argument that works in the present case of 
complex reflection groups. Nevertheless, in this section we shall show that the 
answer to this question is affirmative for the groups G {m,p, N). The argument is 
again based on a reduction to the case of S^. 

First we deal with shifting the parameters < i < m — 1, for the group 
G (m, 1, N). We recall the type-A commutation Viyi — yiVi = 1 + kq J2j=^i 
where y = (a:^, . . . .x'Ji); thus yiV^ = with Yi Viyi - I - KoJ2j^i ^nd 
(V^y^) V^ = V^Yi, for each i. Let w = (1, 1, . . . , 1) e N^. 

Proposition 3.23. Let 1 <.t < m — 1 and let g be any polynomial in y then 

T,{nrx'^g{y)^x'^T,{KT9{y), 
for 1 < i < N , where k' — {kq, ki + 1, . . . , + 1, Kt+i, ■ ■ • , Km-i) ■ 



Proof. By Proposition 3.9 



m— 1 t 



" TT (- + 'is+V^y^-l)v,T[ (- + KS + Y, 

s—m — t s — 1 

m — 1 t 

m^'x'^V, rr (± + Ks + Y,-l)W(- + ns + Y, 



s—m — t s — 1 

m — 1 

S 

m 



s=l 

x'^T,{nTg{y) 



In each of the products the terms commute pairwise so the order does not matter. 
The relation {Viyi) Vt — ViYi is used to move Vi to the front (last in the order 
of operation). The formula for Ti{K')"^ g{y) is obtained by setting ^ = in the 
starting calculation. □ 



The argu ment must be modified for G {m,p, N) for 1 < p < m. Recall from 
Remark 3^ that Ksm/p — and nt+sm/p — i^t for 1 < s < p — \ and 1 < i < — 1- 
We will use k to denote (kqi'^I:-- - j'^m/p-i) in this discussion. The invariants 
for G {m,p, N) are generated by the elementary symmetric functions of degrees 
1,2,... , A^— 1 in y and Here is the modification of the previous proposition. 

Proposition 3.24. For the group G{m,p,N) let 1 <t< j ~ 1, < s < p - I 

and let g be any polynomial in y then 

where k' ^ (^Kq,Ki + - , Kt + Kt+i, . . . , Hm/p-i^ ■ 
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Proof. Suppose first that I < s < p — 1 then 

i-\-srn/p 

- rr,WP^(*+(s-l)m/p)'' TT ( 1 



j=t+l+(s-l)m/p 

m/p—1 



/ \ m/p-l / 1 • \ 



Again the order of the product does not matter because each term is a linear 
function of the operator Yi. The periodicity conditions were applied to yield the 
third line. 

Further (the case ,s = 0) 

T,{Kr/Px'^g{y) 



= m^/Px*- n (- + i^j + T^iyi-T)T^i'[[(- + i^j + Y?ig{y) 

\ rn J . , \ rn J 

j=m-m/p+t+l ^ ' J=l ^ ' 

mlp~\ / _ 1 • \ 

= m™/Px*''A n ^ + + K +y._i) 



= a;*''T,(«:'r/^5(l/). 
In the second line the product over m — y + i + 1 < j < m — 1 is changed to 

t+l<j<^ — Iby replacing j by j + '"^p""^^ and the periodicity of Hj is also 
used. This completes the proof. □ 

Remark 3.25. It may appear that the shift of - is significantly different from the 
shift of 1 for the group G {m, 1, N), but in fact, the parameters Ki should be replaced 
by pKi (for 1 < i < ^ — 1) to conform to the general setup of Section 2 and so the 
shift is effectively 1. 

We turn to the parameter kq associated with the action of the symmetric group. 
Using the known results for Sn, we are going to prove that f {T{K))as {y)g{y) 
= as{y)f{T{K'))g{y), where 6 = (TV - 1,7V - 2, . . . , 1,0) e N^, and as{y) = 
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T\.i<i<3<N iVi - Vj)' = ('^0 + 1, Ki, . . . , Krn-i) and /, g are (real) symmetric poly- 
nomials in y. 

Recall some facts from Section 3.3: for any partition A £ Nq the space X\ (kq) = 
spanlw^A : w £ Sn} = spanjC^A '■ w G Sn] (the R-span) is equipped with two 
permissible inner products (•, Ofc ^'^'^ (''")ko' ^-h^^re the inner product (/, g)^^ — 
f iV (ko)) 9 iv) for /, g G X\ (kq). We have shown that 

m-l y . \ 

(/, g\ = J] (iV - 1) «o + ^ + «^ (/, g)^^^ . 

First we establish the formula {asf,asg)]^ = (05, a^)^, (/, where {f,g)]^i denotes 
the pairing for k' and /, g are symmetric polynomials in y. The result of Heckman 
shows that {asf,asg)^^ = i'^s, as) {f, g) i^^^i- Further, there is a unique 
S'AT-invariant j\ (up to scalar multiple) in Xx, and if Ai > A2 > . . . > Xn then 
there is a unique skew-invariant a a G Xx (see Section 3.3). Further the invariant 
polynomial ax+s (kq) /^s = jx (ko + 1) (note the dependence on the parameter), 
see Opdam p^ ; we take the constant as 1 for convenience. If A, are partitions 
in Nq then A 7^ /i implies Xx (kq) -LXf^ (kq) in any permissible inner product, 
hence (oA+a (kq) , (ko))^, = 0. The polynomials ax+siKQ)/as form a basis 
for the symmetric polynomials so it suffices to prove the formula for the cases 
f = 9 = ax+s (lio) /as- Thus 

{ax+s (ko) , ax+s (fo))^ 

n ( ~ 1) '^0 ^ h Ki ) {ax+s (kq) , ax+s M)f,o 



m ' 

i=l ^ 
m-l N 



\+S 



1=1 ] = 1 \ TO y A,+W-J 

X (a<5,a5)«,„ (jA (ko + 1) ,iA (ko + !))«„ 



= TO™I^+*'I n n f (A^ - j) + - + f (A^ " j) («o + 1) + - + 

X {as, as) {jx (no + 1) ,iA (^o + l))^„+i 



m — 1 



TO 

i=l 



J]^ I (TV - 1) -I h Ki ] (a5,a5)^jj (jA (ko + I) Jx (^o + 1))^./ 



which used the relation between kq + 1 and k' inner products on Xx (hq + 1); and 
the known Sn results. Setting A = shows again that 
{as, as), = TO"!*! n"^' ((^ - ^) ^0 + ii + >^:)s («^, as),^^. 
Proposition 3.26. Suppose f,g are symmetric polynomials in y then 

f (T {K))as {y) g (y) = as {y) f (T («')) 9 {y) , 
where k' — {kq + 1, ki, . . . , Km-i)- 

Proof. Without loss of generality assume that /, g are homogeneous. By the group- 
invariance properties of the pairing / (T (k)) as {y) 9 (y) is a skew- symmetric poly- 
nomial and hence divisible by as {y) with a symmetric quotient. If deg / > deg g the 
quotient is zero. If deg / = deg g then / (T (k)) as {y) g (y) ~ cas (y) for some con- 
stant c; thus by the preceding formula we obtain as {T (k)) / (T (k)) as {y) g {y) — 
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{as [T [k)) as (y)) (/ {T {k')) g (y)) (recall {as, as)^, ^ for generic k, which suffices 
to prove this Q [k] polynomial identity). 

Suppose degf = I < degg = n and let /i be an arbitrary homogeneous sym- 
metric polynomial of degree n — I. Then we have /i (T (k)) / [T (k)) as {y) g {y) 
= as {y) h {T (At')) / {T {k')) g (y), but / (T («')) 9 {v) is symmetric of degree n-l. 
Hence as {y) h {T {k')) f {T («')) 9 {v) = /i {T («)) as {y) f (T («')) 5 {v)- This iden- 
tity holds for all k and implies the claimed formula when k is not singular. The 
formula is again a polynomial in k, hence is valid for all k. □ 

Now we can state the analogue of Corollary 4.5 of 

Corollary 3.27. For G = G{ni,p,N), let tt := x'-"^/P-^'^'"as. Let 1 denote the 
parameter tuple such that lc,i — 1 for both the orbits of reflection hyperplanes C , 
and i — I, . . . , ec — 1 (in the notation k = (kc.i) of Section 2, not the tuple (k^) of 



the present section; cf. Remark 3.25; if p = m or N ~ 1 we have only one orbit). 
For all p,qeP^ we have 

(43) {Trp,TTq)k ^ {Tr,TT)k{p,q)k+i- 

Proo f. As in |^ we have, using Theorem 2.18| , Proposition \i.24 and Proposition 



3.26 



{Trp,TTq)k = {Tr,p*{T{k))nq)k 

= {7r,TTp*{T{k + l))q)k 
= (7r,7r)fc(p,gf)fc+i, 

since we may assume that the degrees of p and q are equal. □ 

This result in fact gives an alternative proof of the explicit description of the radical 
which was derived in the previous subsection, analogous to the proof given in ||] . 

These results may help in formulating more general statements for arbitrary 
complex reflection groups. 
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